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Abstract 

The  ALGOL  grader  programs  are  presented  for  the  computer  evaluation 
of  student  ALGOL  programs.  One  is  for  a  beginner's  program;  it  furnishes 
random  data  and  checks  answers.  The  other  provides  a  searching  test  of 
the  reliability  and  efficiency  of  a  rootfinding  procedure.  There  is  a 
statement  of  the  essential  properties  of  a  computer  system,  in  order  that 
grader  programs  can  be  effectively  used. 


Reproduction  in  Whole  or  in  Part  is  permitted  for  any  Purpose  of 
the  United  States  government.  This  report  was  supported  in  part 
by  Office  of  Naval  Research  Contract  Nonr-225(57)  (NR  044»21l)  at 
Stanford  University. 


Presented  to  the  national  meeting  of  the  Association  for  Computing 
Machinery,  Philadelphia,  27  August  1964,  under  the  title  "Automatic 
machine  grading  progreims".  The  Stanford  computers  used  for  pro¬ 
gram  tests  are  partially  supported  by  the  National  Science  Founda¬ 
tion  under  Grant  No.  GP-<^-8. 


Discussion 


In  connection  vlth  Introductory  programming  and  numerical  analysis 
courses  at  Stanford  University,  grading  programs  have  been  used  Inter¬ 
mittently  since  1961.  Our  programs  furnish  data,  check  student  perfor¬ 
mance  In  various  ways,  sometimes  keep  track  of  running  time,  and  keep  a 
"grade  book"  for  the  problems. 

The  Stanford  routines  are  written  separately  for  each  problem. 

The  most  flexible  and  useful  system  for  elementary  classes  was  used  with 
the  Burroughs  220  computer  In  the  BALGOL  language,  a  dialect  of  ALGOL 
58,  and  will  be  described  first.  Each  grader  program  was  written  as  a 
BALGOL -language  procedure.  It  was  then  compiled  together  with  a  proce- 
dxa*e  called  BUTTERFLY,  written  by  Roger  Moore.  The  result  was  a 
relocatable  machine -language  procedure,  with  a  mechanism  for  equating 
its  variables  to  variables  of  any  BALGOL  program,  in  Just  the  form  of 
the  BALGOL  compiler’s  own  machine -language  libraiy  procedures  (SIN, 

V/RITE,  READ,  etc.).  Finally,  the  grader  program  was  added  to  the 
compiler  library  tape  for  the  duration  of  its  use. 

The  use  of  a  powerful  algebraic  language  and  system  made  It  easy 
for  an  Instructor  to  write  grader  programs  with  sophistication  appro¬ 
priate  to  the  problem.  The  student  needed  only  furnish  one  or  two 
procedure  statements  to  call  a  grader;  we  often  furnished  him  cards  to 
decrease  the  chance  of  error.  Since  each  grader  was  precompiled  on  the 
library  tape,  little  time  was  lost  in  adding  it  tc  each  student's  program 
at  compile  time.  A  simple  handcoded  mechanism  made  it  easy  for  the 
operator  to  rescue  a  program  from  a  nin-time  loop  and  send  it  into  the 


next  case  without  dismissing  the  program  entirely.  It  was  possible  to 
have  several  different  graders  concurrently  on  the  library  tape,  to 
take  care  of  different  classes. 

This  powerful  grading  mechanism  was  possible  only  because  of  the 
BALGOL  compiler  with  its  own  compiler-with-library  generator,  and  because 
BUTTERFLY  could  generate  relocatable  machine -language  programs.  Neither 
our  IBM  7090  BALGOL  system  nor  our  Burroughs  B5000  ALGOL  system  has  been 
so  well  adapted  to  the  grading  problem,  to  our  regret,  and  we  have  had 
to  make  do  with  less  desirable  expedients.  What  these  newer  systems 
lack  is  an  easy  means  of  producing  a  machine -language  library  procedure 
which  is  fully  equivalent  to  a  source -language  procedure  with  several 
parameters . 

We  recommend  grading  p  ograms  to  all  who  teach  programming  and 
numerical  analysis  to  masses  of  students,  but  the  prospective  user  should 
first  carefully  investigate  the  systems  available  to  him. 

We  give  below  a  typical  grading  program,  GRADER2,  which  was  used 
in  connection  with  an  early  problem  in  a  beginning  programming  course. 
GRADER2  is  suitable  for  grading  a  student's  program  which  is  written  as 
a  block.  It  has  been  translated  into  /LGOL  and  is  given  as  part  of  a 
block  containing  one  or  more  student  programs. 

In  ALGOL  there  is  a  practical  difficulty  in  putting  many  beginner 
programs  into  the  same  block  with  GRADER2--a  syntactical  error  in  Just 
one  student  program  may  upset  the  compiler  and  prevent  the  testing  of 
any  program.  It  would  be  better  if  we  could  have  GRADER2  precompiled 
into  a  system  library  and  called  separately  by  each  student. 
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The  student's  problem  is  this:  Given  the  integer  N  (0  <  N  <  10) 
and  the  real  array  elements  A[0],  ...,A[n],  B[0],  B[n],  to  write 

a  program  which  makes  MAX  the  maximum  of  A[0],  A[N]  and  which 

computes  the  numbers  C[0],  C[2  x  N]  defined  by  the  polynomial 

multiplication 

2N  ,  N  ,  N  , 

Z  c[k]t^  ^  ( 5]  A[k]t^)  .  ( j;  B[k]t^)  . 

k=0  k=0  k=0 

The  student  is  told  that  he  must  arrange  his  program  in  the  form: 
begin 

<all  declaration6> 

GRADER2  (<6tudent  number>,  1,  N,  MAX,  A,  B,  C,  START,  FIN); 

START:  <all  statements  of  his  solution> 

GRADER2  (<student  number>,  2,  N,  MAX,  A,  B,  C,  START,  FIN) 

FIN: 

end; 

Note  that  the  subprocedure  SET  UP  of  GRADER2  goes  to  great  trouble 
to  be  sure  that  no  student  will  get  the  same  data  at  different  times, 
and  that  no  two  students  will  get  the  same  data.  This  was  intended  to 
Lc  sure  that  a  student  could  not  get  correct  answers  from  GRADER2  on  one 
run,  and  use  them  for  another  run.  We  doubt  the  value  of  such  pre¬ 
cautions  . 

Observe  that  GRADER2  evaluates  the  correctness  of  the  student 
answers,  but  in  no  way  evaluates  the  running  speed  of  the  program  nor 
the  amount  of  storage  used.  This  is  appropriate  for  a  beginning  student 
of  programming. 
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A  more  advanced  student  should  have  his  performance  examined  more 
critically.  As  an  example  of  this,  we  give  a  second  grader  program 
called  Test,  to  be  uced  in  a  numerical  analysis  class  whose  members  can 
already  program  in  ALGOL. 

The  procedure  Test  listed  below  is  designed  to  examine  rootfinding 
procedures.  The  stu'^ents  are  asked  to  write  an  ALGOL  procedure  which 
finds  an  approximation  to  a  'root*  x  (i.e.,  point  of  sign-change)  of  a 
(not  necessarily  continuous)  function  f  in  the  Interval  fa,  bj.  To  be 
precise,  x  is  any  number  such  that 

f(xo)  <  0  H  f(x^)  >0  (in  the  sense  of  ALGOL  60) 

and 

a<Xo<x<Xi<b 

and 


where  f,  a,  b,  and  €  are  given  parameters.  Such  an  x  always  exists, 
if  f(a)<0sf(b)>0.  Each  student  is  asked  to  submit  an  ALGOL 
program  containing  his  procedure  declaration  and  a  single  statement  of 
the  form 

Test  (rootflnder,  ^student  name  ^  ) 

As  with  GRADER2,  all  submitted  programs  are  then  enclosed  together  in 
an  outer  block,  whose  head  contains  the  declaration  of  the  procedure 
Test.  Thus  no  use  of  library  tapes  is  required.  The  block  structure 
of  ALGOL  plays  the  very  In^jortant  role  that  all  identifiers  used  by 
the  student,  including  the  name  of  his  rootflnder,  are  strictly  local 
to  his  program.  They  can  therefore  be  chosen  freely  and  cannot  Interfere 
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with  identifiers  in  any  other  program.  Nor  can  an  identifier  of  the 
procedure  Test  interfere  with  any  student's  program.  Of  course  this 
technique  requires  that  the  contributions  be  syntactically  correct,  but 
this  is  considered  to  be  the  minimum  requirement  for  acceptance  of  a 
program  from  students  at  this  level. 

In  order  to  obtain  an  estimate  of  the  quality  of  the  programs, 
one  would  like  to  know  the  accuracy  of  the  answers,  the  number  of 
evaluations  of  the  function  f  it  took  to  find  the  root  (”lth  the 
possibility  of  terminating  the  test,  if  a  limit  is  exceeded),  and  per¬ 
haps  also  the  time  it  took  to  find  the  root.  It  is  furthermore  desirable 
to  check  that  the  limits  a  and  b  and  the  tolerance  e  were  not 
changed  dialing  a  test  (this  might  occur,  for  example,  if  these  para¬ 
meters  were  called  by  name  instead  of  by  value),  and  whether  the  argument 
of  f  always  remained  within  the  interval  [a,  b]. 

The  following  description  of  the  procediire  Test  explains  the 
methods  of  achieving  these  goals  within  the  framework  of  an  ALGOL  program. 
The  declaration  of  Test  contains  the  following  variable-declarations 
grade  represents  the  student's  grade;  it  is  cumulated  during 
execution  of  several  partial  tests  of  one  student's 
program. 

m  denotes  his  number  of  successful  tests. 

X  is  a  real  variable  used  as  abscissa  for  the  evaluation  of  f. 
t  records  the  time  snent  by  the  rootfinder. 

A  procedure  P  declared  Inside  Test  is  the  heart  of  the  entire  grader. 

The  body  of  Test  contains  a  series  of  calls  of  P;  each  call  of  P 
contains  as  actual  parameters  the  data  for  one  test  example.  E.g.,  the 


call 


P(0»2,io-5A>l  -  X,  true,  20,  l) 

would  cause  the  testing  of  the  student's  program  with  the  function  f ; 
f(x)  =  1  -  X  in  the  interval  a  =  0,  b  =  2,  with  a  desired  accuracy 
of  3^0’^'  expected  result  (=l)  is  the  fourth  parameter  to  P. 

The  sixth  parameter  indicates  that  a  solution  exists,  the  seventh  is  a 
limit  for  the  number  of  evaluations  of  f,  and  the  eighth  indicates  the 
number  of  the  test  case- 

The  procedure  P  subsequently  calls  the  rootfinder  (which  is  a 
formal  parameter  Lo  Test)  with  the  given  parameters  as  data.  However, 

P  does  not  furnish  the  fxinction  f  directly  to  the  rootfinder,  but 
rather  substitutes  a  function  procedure  Q,  which  is  declared  in  the 
head  of  P.  Each  call  of  Q  then  serves  to  increment  the  counter  of 
calls  of  f  and  is  also  used  to  examine  whether  the  argument  of  f 
lies  within  the  prescribed  interval. 

The  grader  program  has  been  used  on  the  709O  computer.  In  order 
to  measure  the  time  spent  by  the  rootfinder  and  to  recover  from  a 
possible  error  in  the  logic  of  the  student's  program,  two  code  procedures 
have  been  introduced  which  cannot  be  described  in  ALGOL: 

procedure  Setime  (n,L);  integer  n;  label  L; 
initializes  the  core-clock  to  trap  after  n  msec  and  to  transfer  control 
to  L.  Also, 

procedure  Reset  (t);  integer  t; 

disables  the  trap  and  assigns  to  t  the  number  of  msec  spent  since 
initialization  of  the  clock.  Tnese  procedures  protect  the  entire  grading 
run  from  failure  due  to  one  particular  examinee's  inability  to  solve 
a  certain  test  problem. 
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The  authors  feel  that  particular  emphasis  should  be  put  not  only 
on  the  efficiency  of  the  student's  contribution,  but  also  on  its  reliability. 
The  choice  of  the  test  data  reflects  the  possibilities  of  this  grading 
method,  since  "wildly  behaving"  functions  are  used  which  are  not  likely 
to  be  foreseen  by  a  careless  programmer. 

The  program  Test  is  believed  to  mark  a  further  step  in  the  auto¬ 
mation  of  grading.  Whereas  GRADERS  bases  its  grade  only  on  the  binary 
answer  "correct"  or  "wrong".  Test  also  evaluates  a  program's  quality 
i.e.,  reliability  and  effectiveness.  It  thus  relieves  the  teacher  from 
long  and  tedious  grading  work.  Last,  but  not  least,  the  machine  may  be 
more  objective  in  grading  than  the  human,  because  of  its  notable  lack  of 
prejudice  and  its  inability  to  become  bored. 

The  authors  wish  to  acknowledge  valuable  suggestions  made  by  A. 

J.  Perils  and  P.  Naur  in  regard  to  grader  programs. 
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An  elementary  grader  program 


begin 

procedure  GPADER2  (STUDEfn,  ENTRY,  N,  MAX,  A,  B,  C,  START,  FIN); 
value  STUDENT,  ENTRY;  integer  STUDENT,  ENTRY,  N;  real  MAX; 
real  array  A,  B,  C;  label  START,  FIN; 

c omment  We  assume  the  existence  of  library  real  procedure 
TIME  which  produces  the  time  of  day  as  an  integer  in  the 
interval  [0,  2359 ]> 

begin 

real  procedure  RANDOM; 
begin 

comment  The  \'alue  of  RANDC^  at  each  call  is  a  different 
pseudo-random  number  from  a  flat  distribution  in  the 
interval  [0,  1  ] The  body  is  not  written  here  ; 
end  RANDOM; 

own  real  array  CC[0  10 ! ; 
real  S ;  own  real  MMAX ; 

Integer  B3 »  BU,  J,  K; 
own  Integer  TALLY,  Bl,  B2; 
switch  JUMP  :=  LI,  L2; 
procedure  SET  UP  (CASE,  N); 
value  CASE;  integer  CASE,  N; 

comment  SET  UP  furnishes  the  student's  data,  which  depend  on 
the  student's  number,  the  time  of  day,  and  a  pseudo-random 
number.  SET  UP  also  solves  the  case  for  the  use  of  EJVALUATE; 
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begin 


for  K  :  =  0  step  1  \mtll  N  do 
begin 

A[k]  :=  RANDOM  +  (STUDENT  +  TIME)  X  ^q-4; 

B[k]  :=  RANDOM  x  sign( RANDOM  -  O.5) 
end; 

comment  Now  the  student  is  messaged  on  the  line-printer  what 
data  have  been  generated  for  him; 
outstring  (l,  ^FOR  »-i  CASE  * ) ;  outinteger  (l,  CASE); 
outstring  (1,  ^GRADER2  ^  FURNISHES  i_i STUDENT' ');  outinteger(l, 
STUDENT ) ;  outstring  (l  /  THE«-j  FOLLOWING  u-i  DATA:  i_i  A  uj  IS  *) 
for  K  :=  0  step  1  until  N  ^  outreal  (l,  A[K]); 
outstring  (1,  »IS*); 

for  K  :=  0  step  ]  un^xl  N  ^  outreal  (l,  B[K]); 
comment  Now  GRADER2  solves  the  student's  case  for  itself. 
GRADER2  does  not  use  A[K]  or  B[K]  for  any  values  of  K 
outside  0  <  K  <  N; 

MMAX  :=  A[0]; 

for  K  ; =  1  step  1  until  N  ^ 

A[K]  >  MMAX  then  MMAX  :=  A[Kj; 
for  K  : =  0  step  1  until  N  do 
begin 

S  :=  0; 

for  J  :=  0  step  1  until  K  ^  S  :=  S  +  A[J]  x  B[K-J]; 

CC[K]  :=  S 
end; 

for  K  :=  N+1  step  1  until  2xN  ^ 


begin 


S  :=  0; 

for  J  :=  K-N  step  1  until  N  ^  S  :=  s  +  A[J]  x  B[K-J]; 
CC[K]  :=  S 
end; 

comment  Now  SET  UP  has  solved  the  problem,  and  we  exit 
to  START,  the  entry  to  the  student's  solution.  The 
next  call  of  GRADER2  will  bring  us  back  to  EVALUATE; 
TALLY  :=  TALLY  +  1; 
go  ^  START; 
end  SET  UP; 

procedure  EVALUATE  (CASE,  N); 

value  “CASE;  integer  CASE,  N; 
begin 

B3  :=  1; 

comment  EVALUATE  examines  the  student's  answers,  writing 
them  and  its  ov-ti  answers,  with  comments  on  the  student's 
performance,  all  on  the  line-printer; 
outstring  (l,  ^ FOR  i_i  CASE *) ;  outiateger  (l,  CASE); 
outstring  (l,  ^ STUDENT^);  outinteger  (l,  STUDENT); 
outstring  (l,  ^  COMPUTES C  TO  BE  ^ ) ; 
for  J  :=  0  step  1  until  2  x  N  ^  out real  (l,  C[ J] ) ; 
outstring  (l,  'gRADER2  COMPUTES  u_.C  TO  u_iBE*); 
for  J  :=  0  step  1  until  2  X  N  ^  out real  (l,  CC[ J] ) ; 
for  K  :=  0  step  1  until  2  X  N  do 

abs(C[K]  -  CC[K] )  >  then  B3  :=  0; 
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^  B3  =  1  then  out  string  (l,  ^  C  *__•  IS  i_»  ACCEPTABLE ') 

else  outstrlng  (1,  ^  C  uj  IS  NOT  ACCEPTABLE  *); 
comment.  A  large  tolerance  was  allowed  for  possible 
differences  in  the  solutions  because  of  different 
rounding  off; 

b4  :=  0; 

MAX  =  MMAX  then 
begin 

Bh  ;=  1; 

outstring  (1,  ‘  MAX  »_i  IS  i-j CORRECT ') 

end 

else  outstring  (1,  ^  MAX  «— «  IS  «_» INCORRECT  *) ; 
end  EVALUATE; 

comment  Now  come  the  statements  of  GRADER2  itself; 

ENTRY  =  1  Uien  TALLY  :  =  0  else  go  ^  JUMP[  TALLY]  ; 
comment  On  the  first  call  of  GRADER2  by  each  student, 

ENTRY  is  1.  On  the  later  calls  it  is  2.  This  and 
TALLY  provide  the  mechanism  for  permitting  different 
entries  to  GRADER2  on  different  calls; 

N  :=  5; 

SET  UP  (l,  3); 

LI:  EVALUATE  (l,  5); 

B1  :=  B3;  B2  ;=  B4; 

N  :=  h; 

SET  UP  (2,  U); 
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L2:  EVALUATE  (2,4); 

comment  Case  2  is  now  complete,  and  GRADER2  punches  a 
card  for  the  "grade  book"; 

for  K  :=  STUDENT,  2,  Bl,  B2,  B3,  B4  ^  outinteger  (2,  K); 
comment  GRADER2  now  summarizes  the  situation  for  the 
student's  line -printer  listing; 
outstring  (l,  ^STUDENT');  outinteger  (l,  STUDENT); 
out  string  (l,  ‘SCORES*);  outinteger  (l,  B1+B2+B3+B4); 
outstring  (l,  ‘ OUT  OF  «_»  4  u_i  ON  t_i  PROBLEM  •_  2  .  uj  i-i  IF  cj  SCORE  IS  u_» 
LESS  (_»  THAN  <_i  4 ,  l_i  PLEASE  SUBMIT  i_»  REVISED  uj  PROGRAM  i-_.  LATER .  *  ) ; 
comment  Now  the  program  exits  to  the  conclusion  of  the 
student's  solution; 
go  to  FIN 
end  GRADER2; 

comment  Now  follow  the  students'  programs; 
begin 

comment  Here,  for  example,  is  the  program  for  student 
number  515  >  with  its  calls  on  GRADER2; 
real  array  A,  B,  C  [0:25]; 
real  S,  MAX; 
integer  J,  K,  N; 

GRADER2  (515,  1,  N,  MAX,  A,  B,  C,  START,  FINISH); 

START:  for  J  :=  N+1  step  1  until  25  ^  A[J]  :=  B[jj  :=  0; 

MAX  A[N]; 

for  K  ;=  N-1  step  -1  until  0  ^ 
if  MAX  <  A[k]  then  MAX  ;=  A[k]; 
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for  K  ;=  0  step  1  until  2xN  do 
begin 

S  :=  0; 

for  J  :=  0  step  1  until  K  ^  S  :=  S  A[J]xB[K-J] 
C[k]  :=  S 
end; 

GRADER2  (515,  2,  N,  MAX,  A,  B,  C,  START,  FINISH); 
FINISH: 

end  program  of  student  515; 
begin 

comment  Program  of  another  student  ...  ; 

end 


end  tests  of  all  student  programs 
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An  advanced  grader  program 


begin  comment  grader  program  for  root-finding  procedures; 
procedure  Test  (Rootfinder,  Name);  procedure  Rootfinder;  string  Name 
begin  real  x;  Integer  m,  grade,  time; 

procedure  P  (low,  up,  eps,  root,  f.  Is  root,  Interatlon  limit, 
problem  no ) ; 

value  low,  up,  eps,  root.  Is  root.  Iteration  limit,  problem  no 
real  low,  up^  eps,  root,  f; 

Integer  Iteration  limit,  problem  no; 

Boolean  is  root; 

begin  real  low  1,  up  1,  eps  1,  root  1; 
integer  n,  t;  Boolean  is  root  1; 

procec are  Setime  (n,  L);  Integer  n;  label  L;  code; 
procedure  Reset  (t);  integer  t;  code; 
procedure  error  (text,  charge); 

value  charge;  integer  charge;  s'*'rlng  text; 
begin  out string  (text);  grade  :=  grade  -  charge; 

If  grade  <  0  then 

begin  outstring  (^ grade  =  O’); 

£0  T  exit 

end 

end  error; 

real  procedure  Q(y);  value  y;  real  y; 
begin  y  <  lov  1  V  y  >  up  1  then 

begin  error  (^Argument  •—*  outside  i-j  interval’ ,  10); 
Reset(t);  go  P  exit 
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end; 


n  :=n  +  l;^n>  iteration  limit  then 

begin  error  (  Convergence  •—•is  •—•too  i_»  slow  ,  5;; 

Reset(t);  go  ^  P  exit 
end; 

X  :=  y;  Q  :=  f 

end  Q; 

low  1  :=  low;  up  1  :=  up;  eps  1  :=  eps;  n  :=  0; 
out  string  (‘ problem  •__•  no.  =^);  outreal  (problem  no); 

Setime(lOO,  fail); 

Rootfinder  (low  1,  up  1,  eps  1,  Q,  root  1,  is  root  l); 

Reset(t);  time  :=  time  +  t; 
if  low  1  /  low  V  up  1  /  up  then 

error  (‘ boundary  i—i  was  t-j  altered^,  3)> 
if  eps  1  /  eps  then  error  (^  tolerance  i-»  was  altered’ ,  5); 

1  is  root  then 

begin  if  is  root  1  then 

error  ( ^  solution  i—j  found  t-i  where  t-i  none  l_j  exists 5) 
else  begin  outstring  (‘ correct  «—i  reaction  •—»  for no  uj  root’ ) ; 
m  :  =  m  +  1 

end 

end 

else 

begin  real  tol;  tol  :=  abs  (root  -  root  l); 

if  tol  >  eps  then  error  (^incorrect  t-i  root’ ,  5) 

else  begin  outstring  (*  correct  •—<  root  i-^found’);  m  :=  m+1 
end; 
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outstring  (^no.  i_j  of  iterations  » ’);  outreal  (n); 

end; 

^  ^  P  exit; 

fail:  error  (^f allure^,  10); 

P  exit: 
end  P; 

m  :  =  0;  grade  :=  100;  time  :=  0;  outstring  (Name); 

P(-2,  2,  ^q-6,  -1,  x+1,  true,  10,  l); 

P(-l>  io"^»  true,  10,  2); 

P(-l,  1,  ^q-6,  1,  x-1,  true,  10,  3); 

P(2,  5,  3^0-6,  0,  x-1,  false,  10,  k); 

P(-2,  3-5,  10’^^  2,  xt3-xx3  -  2-3^q-20,  true,  30,  5); 

P(l0-3#  99-9,  0,01,  X  +  l/x  -  100.01,  true,  50,  6); 

P(“l>  2,  -5,  0,  sign(x),  true,  30,  7); 

P(-3,  100,  10-^'  exp(-x)  -1,  true,  50,  8); 

P(0,  20,  3^q-4,  0.95,  (x  +  0.05)  f  0.1  -  1,  30,  9); 

P(0,  100,  3^0-5^  ^  x  <  1  then  x-1  else  ^q-IO,  true,  30,  10); 

P(-2.4,  4.2,  ^q-4,  3,  ((((x-3)  X  x+5)  x  x-15)  x  x+4)  x  x-ll, 
true,  50,  11); 

P(53^0-3;  1,  53^0-3;  0.0265,  ^  x  <  0.02122  then  -1  else 
X  >  0.03183  then  1  else  co.s(l/x),  true,  30,  12); 
outstring  (*  end  »— •  of  «— 1  test.  u_i  No.  1— •  of  i-i  correct  «-j  problems  =’); 
outreal  (m);  outstring  (^time  =’);  outreal  (time); 
outstring  (‘grade  =’);  outreal  (grade); 

T  exit: 
end  T; 
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comment  Subsequently  follow  the  students'  programs,  each  containing 


a  procedure  declaration  and  a  call  of  Test  enclosed  in  a  block; 
begin 

procedure  Bisect  (xO,  xl,  tol,  func,  result,  is  result); 
real  xO,  xl,  tol,  result; 
real  procedure  func; 

Boolean  is  result; 
begin  . 


end  Bisect; 

Test  (Bisect,  ^  Tom  i_i  Jones 
end; 


comment  further  students'  programs  follow  here; 


end  Grader  program 
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